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ABSTRACT 

This report describes the PLATO integration strategies used 
by Mashpee High School in Mashpee, MA to improve student performance on the 
Massachusetts Comprehensive Assessment System (MCAS) test, the state’s skill 
exam. The MCAS test covers two areas, mathematics and English, and is tied to 
high school graduation. Mashpee High School’s efforts and the focus of this 
report are on improving student math scores. Mashpee High School used PLATO 
to: (1) match students’ PLATO curriculum to target objectives covered in the 

MCAS; (2) align the curriculum to the state standards; (3) provide individual 
remediation for academically at-risk students to pass the MCAS; and (4) 
provide individual assessment and tracking. This report evaluates the general 
effectiveness of the school's remediation strategies that included PLATO 
coursework, better alignment with state standards, staff development, 
improved delivery of traditional instruction, standards-based lesson 
planning, and helping at-risk students improve study and organizational 
skills. This report describes the manner in which the PLATO was used at 
Mashpee High School and examines the effectiveness of the MCAS remediation 
effort. (Author /KHR) 
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Executive Summary 



Mashpee High School, Mashpee MA, a suburban school, has used PLATO from Fall 2000 to 
help under-performing students pass the state mandated competency exam, the Massachusetts 
Comprehensive Assessment System (MCAS) exam. Mashpee High School used PLATO in 2000-2001 
exclusively to help students improve Math scores. There has been a strong commitment from the 
administration and faculty to customize instruction to align the curriculum to state standards covered 
on the MCAS exam. Mashpee uses a dedicated PLATO lab to help tenth graders identified as at risk of 
failing the MCAS exam 

The purpose of this evaluation report is to describe the manner in which PLATO has been used 
at Mashpee High School and to examine the effectiveness of the MCAS remediation effort. 

Some of the more important results of this evaluation include: 

• MCAS math scale scores improved significantly for the 87 students who were identified as 
“at risk” of failing and enrolled in the Mashpee Fall 2000 PLATO remediation program. 
These students’ scores improved from an average of 215.7 (passing level of 220) on the 
1999 exam (when they were in 8 th grade) to 236.1 on the 2001 exam when they were 
sophomores, a difference significant at less than the .001 level and with an estimated effect 
size 1.27. 

• The gain score of 20.4 points for these 87 “at risk’ students was more dramatic 
(statistically) than the improvement of 1 1 .2 points experienced by students not at risk, p < 
.05, estimated effect size 1 .27. 

• A significant positive relationship was identified between student PLATO usage data 
(number of learning modules mastered) and their MCAS math scale scores, r = .53, p < 
. 001 . 

• The PLATO teacher-coordinator is quite positive about PLATO and believes that PLATO 
use directly contributed to student improvement on the MCAS scores. The district 
superintendent credits PLATO use as one of the five factors contributing to the gain. 

Three Tables and two Figures are included that present MHS and state MCAS test results and 
PLATO data. 
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Introduction 



This report describes the PLATO integration strategies used by Mashpee High School 
(MHS), Mashpee, MA to improve student performance on the Massachusetts Comprehensive 
Assessment System (MCAS) test, the state’s skills exam. The MCAS test covers two areas, Math 
and English and will be tied to high school graduation in 2003. Mashpee High School’s (MHS) 
efforts, and the focus of this report, were on improving student Math scores. This has been 
Mashpee’s single-minded goal for using PLATO since they adopted it for this purpose in Fall 
2000. They use PLATO to meet the following needs: 

• Match student PLATO curriculum to target objectives covered in the MCAS 

• Align the curriculum to the state standards 

• Provide individual remediation for academically at-risk students to pass the MCAS 

• Provide individual assessment and tracking 

This report evaluates the general effectiveness of the school’s remediation strategies 
which included: PLATO coursework, better alignment with state standards, staff development, 
improved delivery of traditional instruction, standards-based lesson planning, and helping at-risk 
students improve study and organizational skills. The purpose of this report is to describe the 
manner in which the PLATO was used at MHS and to examine the effectiveness of the MCAS 
remediation effort. 
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Program Description 



Learners. Mashpee High School (MHS) serves a largely Caucasian, working middle 
class area on Cape Cod. Mashpee is a resort town with a large number of absent, second-home 
owners who live there only in the summers. There are approximately 987 students currently 
enrolled at MHS, 83 percent of whom are white, 7 % Native American, 6 % African American, 
and 3 % Hispanic students. Eleven percent of MHS students receive a free or reduced lunch from 
the federal lunch program. The average household income in Mashpee in 2000 was $32,624. 

Program Goal. In 1999, MCAS Math scores for the MHS tenth graders had fallen to 15 th 
among the 16 high schools on Cape Cod creating a sense of urgency to reverse this trend. MHS 
launched a comprehensive program to improve MCAS scores for at-risk students that included 
curriculum realignment, staff development, and standards-based planning and delivery of 
traditional instruction. In Fall 2000, the PLATO-based remediation Math course was added to 
strategy. This course was required of sophomores who were danger of failing the Math portion 
of the MCAS (to be taken May 2001). Students were classified as “at risk” based on their 8 th 
grade MCAS scores. Rising sophomores whose 8 th grade Math score were near or below the 
passing MCAS scale score of 220 were automatically enrolled in the remediation course in Fall 
2000. This course, which met daily for 45 minutes per session, used PLATO to align the course 
content as closely as possible the competencies that were covered on the MCAS exam. This is 
the single unambiguous goal for PLATO use at MHS: to provide instruction to help struggling 
students pass the MCAS exam. 

Mashpee’s s proactive strategy to identify students early (based on eighth grade MCAS 
release test) is grounded in the belief that these students’ best chance to pass the MCAS is on 
their first attempt. Once students have failed the MCAS in their sophomore year, they tend to 
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lose motivation making successful remediation in the junior and senior years more difficult. 
MHS also used PLATO for ninth grade students in the Spring semester, but that was not 
examined in this report. 

Program Implementation Description. Mr. Rob Miceli in consultation with the MHS 
Math faculty developed a 34-module MCAS-aligned PLATO curriculum 1 that all students 
worked through. All tenth graders who scored marginally or failed the Math section of the 8th 
grade MCAS exam were enrolled in this highly targeted course. Students worked on the PLATO 
curriculum four days a week and worked on study skills, organizational, and test-taking skills on 
the fifth day. During the classes, there were opportunities for one-on-one help from Mr. Miceli, 
who is a certified teacher. There were also parent and community volunteers who worked as 
needed in the lab to assist high-need students. The management of the remediation effort 
required the full time efforts of a PLATO teacher-coordinator, whose task it was to monitor 
student progress through the course and assign course grades. Course grades were assigned 
based on the number of PLATO modules completed and several other criteria such as 
participation and attendance. 2 

Instructor Characteristics and Role in Program. Mr. Rob Miceli is the PLATO teacher- 
coordinator. He teaches the course, monitors student progress in the PLATO modules and 
follows up with students who need additional assistance. 



1 Instructional features of the PLATO curricula are described in Foshay, R. (1998), Instructional Philosophy 
and Strategic Direction of the PLATO System. PLATO Technical Paper #3. Bloomington, MN: PLATO 
Learning, Inc. -ed. 

2 This is an example of the skill building instructional model more fully described in Foshay, R. (2000), 
Instructional Models: Four Ways to Integrate PLATO Into the Curriculum. PLATO Technical Paper #6. 
Bloomington, MN: PLATO Learning, Inc. -ed. 
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Evaluation Design 



The MCAS exam is the primary measure examined here. MCAS scale scores range from 
200 - 280, with a passing threshold of 220. Beginning with the class of 2003, all Massachusetts 
high school graduates will be required to pass the MCAS in English and Math. The state 
classifies student MCAS performance into four categories: 

• Advanced - for students who score 260 - 280 

• Proficient - for students who score 240 - 259 

• Needs Improvement - for students who score 220 - 239 

• Warning/Failing - for students who score below 220. 

The current evaluation examines MCAS scores and PLATO module-mastery data, and 
summarizes an interview with Mr. Rob Miceli. MCAS scores are examined to detect differences 
in student performance - the stated purpose of the PLATO course. PLATO data are examined to 
identify any relationships that may exist between PLATO use and student performance on the 
MCAS exam. For the academic year 2000-2001, Mr. Miceli provided PLATO and MCAS data 
for 189 tenth graders (99 enrolled in the Fall 2000 PLATO course, 90 were not). Of these 189 
students, sixty-three were missing either 8 th or 10 th grade MCAS scores and were not considered 
in the present evaluation, reducing the total participants to 126 (87 enrolled in PLATO, 39 not). 
Recall that students were assigned to the PLATO course based on their 8th grade MCAS scores. 
The average 8 th grade MCAS scale score of the 87 enrolled students was 21 5.7 (passing score 
220), while the average score for the non-PLATO group was 234.2. Finally, MHS scores were 
compared to the overall state MCAS scores for the same years. 



Mashpee High School 



Page 6 



Data Analysis. In reporting the interview results, common main ideas were collapsed and 
summarized. Since MCAS gain scores (taken in 8 th grade and repeated in 10 th grade) were of 
primary interest here, a Repeated Measures analysis of variance was used, which tested whether 
observed gains are significant at the .05 alpha level 3 , or were just due to random fluctuations. 
The Repeated Measures test also allowed for comparison between the two groups, PLATO and 
non-PLATO. In other words, it tested whether one group outperformed the other. In addition, 
effect sizes were estimated. 

Also of interest here, is whether PLATO use, that is the number of modules students 
completed and mastered, was associated with student performance on the MCAS exam. Pearson 
Product Moment bivariate correlations were used to examine the relationship between PLATO 
use and 10 th grade MCAS test scores to determine whether or not MCAS gains were likely 
associated with the PLATO intervention. 

Procedures for data collection. Mr. Miceli provided both PLATO and MCAS data for all 
students. State MCAS data were available at the state web site, http://www.doe.mass.edu/mcas . I 
interviewed by telephone Mr. Rob Miceli, the PLATO teacher-coordinator. I used the PLATO 
site overview questions to structure the interviews, and then allowed the line of inquiry to be 
guided by Mr. Miceli’s concerns and perspectives. 



3 The .05 alpha level of significance is a widely accepted threshold for statistical tests; findings that exceed 
this threshold, i.e., < .05, are believed NOT to be a result of chance. 
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Results 



The results are organized into three sections, MCAS scores, PLATO data, and Interviews. 
The MCAS Scores section examines the MCAS Math performance of all MHS tenth graders 
who took the test in both the 8 th and 10 th grades 4 . For analysis purposes, students were grouped 
into two categories; those who were enrolled in the PLATO course and those who were not. The 
PLATO Data section presents module mastery data for the students who used PLATO during 
Fall 2000, in preparation for taking the May 2001 MCAS exam. Correlations were calculated 
between students’ PLATO module data and their MCAS scores. The Interviews section 
summarizes the interviews with the principal and the PLATO teacher-coordinator. 

MCAS Scores 

Overall student scores increased significantly from 8 th grade to 10 th grade, increasing 
from an average of 221.5 to 239.0, F(l, 124) = 108.64, p < .001 (see Table 1). Further, both 
treatment groups, PLATO and non-PLATO, enjoyed a significant increase 5 in MCAS 
performance from 8 th to 10 th grade. But of particular interest is the significant interaction, F(l, 
124) = 9.08, p = .003, between the treatment groups and the scores recorded on each test date. As 
mentioned, student scores in both groups improved significantly, but the interaction reveals that 
the PLATO group’s improvement (from M= 215.5 to M= 236.1, estimated effect size 1.27 6 ) 
was more dramatic (statistically) than the improvement of the students in the non-PLATO group 

4 Wilks' Lambda multivariate test was significant [F (1, 124) = 108.6, p < .001] which warranted further 
univariate tests. 

5 After the significant univariate effect was found, Tukey's Wholly Significant Differences post hoc test 
was applied to examine individual differences across groups. This test established that gain scores across 
groups larger than 5.68 were significant at the .05 level. Students in both PLATO and non-PLATO groups 
achieved gain scores that exceeded that threshold. 
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